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Description 



CONTROLLER AND REMOVABLE USER 
INTERFACE (RUI) FOR CONTROLLING 
MEDIA EVENT 

Cross Reference to Related Applications 

[0001] The present application claims priority under 35 U.S.C. 

section 119 to Craig Gravina U.S. provisional patent appli- 
cation serial no. 60/ , , titled "SmartToys Multimedia 

Learning System," filed November 1, 2002 with the U.S. 
Patent & Trademark Office (attorney docket number 
GRAV-0001), which provisional patent application is 
hereby incorporated by reference herein. 
Copyright Statement 

[0002] All of the material in this patent document, including 

source code, is subject to copyright protection under the 
copyright laws of the United States and of other countries. 
The copyright owner has no objection to the facsimile re- 
production by anyone of the patent document or the 



patent disclosure, as it appears in the Patent and Trade- 
mark Office patent file or records, but otherwise reserves 
all copyright rights whatsoever. 
Computer Program Listing Appendix 

[0003] Submitted herewith and incorporated herein by reference 
are source code files comprising a computer program list- 
ing appendix that represents a preferred embodiment of 
the present invention. The computer program listing ap- 
pendix includes source code for a script engine and 
source code for a compiler for compiling of script. The 
source code for the script engine is written in ANSI C, and 
the source code of the compiler is written in Visual Basic. 
The target hardware for this implementation is a PIC mi- 
croprocessor, model number 18F8720. Forty-three com- 
puter listing files are submitted herewith as itemized on 
the Transmittal, which is incorporated herein by reference. 
All files represent source code of the script engine except 
for those files as identified in the "readme.txt" file and the 
"PushPlayScriptingAPI.txt" file. 
Background of Invention 

[0004] Fie i d 0 f tne i nven tion 

[0005] As a preliminary matter, the field of the present invention 



generally relates to controlling media events using a con- 
troller and removable user interface (RUI) and, with regard 
to certain preferred embodiments, to controlling presen- 
tation of media content using one or more controllers and 
one or more RUIs. In this regard, a media event includes 
the displaying of video content and/or audio content, re- 
ferred to herein as media presentation. Generally, how- 
ever, a media event also may include the capturing, 
recording, transferring, and/or moving of video and/or 
audio content, depending upon the context. 
[0006] Background of Certain Preferred Embodiments 

[0007] As of 2002, DVD players continue to grow and all indica- 
tions suggest that sales will remain strong for years to 
come. Shipments of DVD players grew by 61% in 2002, 
reaching a total install base of over 40M US households. 
With a proliferation rate that makes the device the fastest 
adopted format in electronics history, most estimates pre- 
dict an install base of at least 60M households by 2006. 
The DVD format, introduced in 1997, will likely be ubiqui- 
tous within 12 years, less than half the time it took for 
VCRs to reach that status. 

[0008] Moreover, due to a growing desire to educate (and oc- 
cupy) children through television and videos, families with 



children under four years old are now the highest video 
purchasing customers with an astonishing average of 
preschool home video market. Indeed, parents have been 
recently become particularly interested in educational 
videos for their youngest children, the infant/toddler seg- 
ment. However, despite the undeniable appeal to children 
of videos, many parents in focus groups confessed unease 
at using videos with their youngest children due to the 
"passive" nature of the viewing. Unlike educational toys, in 
which the experience of the infants and toddlers is "hands 
on," children may tend to lose interest in educational 
videos, especially when an educational video is highly 
repetitive, repeating one basic lesson over and over again 
with various puppets, cartoons, songs and so on (which 
most educational videos tend to do). 
[0009] Accordingly, a need exists for an interactive educational 
DVD video system that is interactive and, thereby, tends 
to maintain the attention and interest of children viewing 
the video. In this respect, and in accordance with an as- 
pect of the present invention, a child viewing the video is 
able to interact, for example, by controlling educational 
segments of the video that are displayed; and/or by re- 
sponding to questions presented in the video with appro- 



priate responses indicating whether the response is cor- 
rect. 

[0010] while certainly broader in its utility, the present invention 
addresses this need with respect to certain preferred em- 
bodiments thereof, as described in detail below. 
Summary of Invention 

[0011] Briefly described, the present invention relates to control- 
ling a media event. 

[0012] | n a fj rst aspect of the present invention, a host system 
includes a machine readable medium containing media 
content and an apparatus for controlling presentation of 
the media content. The apparatus includes a removable 
user interface (RUI) and a controller removably coupled 
together. In this aspect of the present invention, the RUI 
includes user inputs and machine executable instructions 
(i.e., software) that are specific to the media content. The 
controller includes a processor, a program executed by 
said processor that interprets the machine executable in- 
structions of the RUI, and a library of software instructions 
accessible to the program for communicating to the host 
system, in a protocol of the host system, commands relat- 
ing to presentation of the media content. The program, in 
response to actuation of a user input, performs the steps 



of reading and/or interpreting the machine executable in- 
structions of the RUI, accessing the software instructions 
in the library based on the machine executable instruc- 
tions read from the RUI, and communicating commands to 
the host system based on the accessed software instruc- 
tion of the library. 
[0013] | n a different, second aspect of the present invention, a 
media device includes a controller in at least intermittent 
communication with a media device and an overlay that is 
removably coupled to the controller. The controller in- 
cludes a processor for executing software instructions. 
The overlay includes a plurality of user inputs and a ma- 
chine readable medium having machine executable in- 
structions comprising commands for controlling media 
events, whereby an appropriate communication to the 
media device is determined by the processor of the con- 
troller upon actuation of a user input. In accordance with 
this particular aspect of the present invention, the user 
inputs are exposed for direct contact by a user in actua- 
tion thereof, with the actuation of a user input causing the 
communication from the controller to the media device; 
the machine executable instructions of the overlay may or 
may not be specific to any media content; and the com- 



mands may or may not be media device independent. 
[0014] These and other aspects, as well as features of the 

present invention, will be more readily understood upon 
consideration of the attached drawings and of the follow- 
ing detailed description of preferred embodiments of the 
present invention. 
Brief Description of Drawings 

[0015] Further features and benefits of the present invention will 
be apparent from a detailed description of preferred em- 
bodiments thereof taken in conjunction with the following 
drawings, wherein similar elements are referred to with 
similar reference numbers, and wherein, 

[0016] FIG. 1 is an overview of a preferred embodiment of a sys- 
tem of the present invention having a media device for 
presenting media presentation. 

[0017] FIG. 2 is a perspective view of a preferred embodiment of 
an apparatus of the present invention for controlling me- 
dia presentation, which figure illustrates the combination 
of a removable user interface (RUI) with a controller in 
forming the apparatus. 

[0018] FIG. 3 is a perspective view of three media packages in ac- 
cordance with a preferred embodiment of the present in- 
vention, each media package including a RUI and a DVD 



pair, wherein the media content of the DVD of a respective 

pair corresponds to the RUI of the pair. 
[0019] FIG. 4 is an other media package in accordance with a 

preferred embodiment of the present invention. 
[0020] FIG. 5 is an other media package in accordance with a 

preferred embodiment of the present invention, wherein 

the media content comprises home videos taken with a 

digital recorded that is saved on the DVD of the media 

package. 

[0021] FIG. 6 is a perspective view of another preferred embodi- 
ment of a RUI and controller of the present invention for 
controlling media presentation. 

[0022] FIG. 7 is a perspective view of another preferred embodi- 
ment of a RUI and controller of the present invention for 
controlling media presentation. 

[0023] FIG. 8 is a plan view of a preferred embodiment of a RUI of 
the present invention for combining with the controller of 
FIG. 9. 

[0024] FIG. 9 is a plan view of a preferred embodiment of a con- 
troller of the present invention for combining with the RUI 
of FIG. 8, which controller includes a switch matrix. 

[0025] FIG. 10 is a plan view of a preferred embodiment of a RUI 
of the present invention for combining with the controller 



of FIG. 11, which RUI includes a switch matrix. 
[0026] FIG. 11 is a plan view of a preferred embodiment of a 

controller of the present invention for combining with the 
RUI of FIG. 10. 

[0027] FIG. 12 is a view of a computer screen representing an ex- 
emplary script in accordance with a preferred embodiment 
of the present invention. 

[0028] FIG. 13 is a view of a computer screen representing an ex- 
emplary script in accordance with a preferred embodiment 
of the present invention. 

[0029] FIG. 14 is a view of a computer screen representing an ex- 
emplary script in accordance with a preferred embodiment 
of the present invention. 

[0030] FIG. 15 is a view of a computer screen representing an ex- 
emplary script in accordance with a preferred embodiment 
of the present invention. 

[0031] FIG. 16 is a view of a computer screen representing ma- 
chine-executable instructions of a library of a controller in 
accordance with a preferred embodiment of the present 
invention, the instructions being specific to a Sony DVD 
player. 

[0032] FIG. 17 is a view of a computer screen representing an ex- 
emplary script in accordance with a preferred embodiment 



of the present invention. 
[0033] FIG. 18 is an illustration of operation of the Interpreter in 
a preferred embodiment of the present invention, and in 
accordance with the exemplary script of FIG. 17. 
Detailed Description 

[0034] As a preliminary matter, it will readily be understood by 
those persons skilled in the art that the present invention 
is susceptible of broad utility and application in view of 
the following detailed description of preferred embodi- 
ments of the present invention. Many devices, methods, 
and adaptations of the embodiments other than those 
herein described, as well as many variations, modifica- 
tions, and equivalent arrangements, will be apparent from 
or reasonably suggested by the following detailed, without 
departing from the substance or scope of the present in- 
vention. Accordingly, while the present invention is de- 
scribed herein in detail in relation to preferred embodi- 
ments, it is to be understood that this disclosure is illus- 
trative and exemplary and is made merely for purposes of 
providing a full and enabling disclosure of the present in- 
vention. The detailed description set forth herein is not 
intended, nor is to be construed, to limit the general 
breadth of the present invention or otherwise to exclude 



any such other embodiments, adaptations, variations, 
modifications and equivalent arrangements, the present 
invention being limited only by the claims and equivalents 
thereof. 

[0035] with reference to FIG. 1, a preferred embodiment 100 of a 
system of the present invention is illustrated. This pre- 
ferred embodiment 100 includes a multimedia system 
having a DVD player 122 for reading DVD 112 and associ- 
ated video monitor or television 124 for displaying on 
screen 105 media content read from DVD 112. The DVD 
112 in this preferred embodiment is an educational video 
for a child that pertains to different methods of trans- 
portations, including transportation by hot air balloons, 
sail boats, trains, trucks, and buses. The DVD player 122 
is a conventional DVD player having an infrared receiver 
for receiving commands controlling presentation (e.g., 
display on screen 105) of the media content of the DVD 
112. Conventionally, these commands are issued from a 
remote control device that accompanied the DVD player 
when it was purchased, or from a "universal" remote con- 
trol device that was purchased separately and that in- 
cludes the ability to send commands for various different 
DVD players including DVD player 122. 



[0036] The preferred embodiment 100 of FIG. 1 also includes an 
apparatus for controlling the presentation of the media 
content, but the apparatus is not one of these conven- 
tional remote control devices. Instead, the apparatus for 
controlling the presentation of the media content is a 
child's activity table for control of the media content by 
the child. In this regard, the activity table comprises a 
platform or table like structure comprising a base struc- 
ture 106 having any suitable number of legs or supports 
108 (which may or may not be detachable), and an upper 
component comprising an overlay 102. The overlay 102 
includes a plurality of user inputs comprising large but- 
tons 104, and the activity table 106 includes the ability to 
issue commands wirelessly via signals 126 to the DVD 
player 122 in response to the pushing of the buttons by 
hand. 

[0037] | n particular, the pushing of a button (i.e., actuation of a 
user input) results in the DVD player 122 displaying a par- 
ticular educational segment on screen 105. Moreover, in 
this preferred embodiment 100, the button includes 
graphical indicia pertaining to the media content that is 
displayed as a result of pushing the button. Thus, the 
pushing by hand 128 of the button including indicia of a 



train results in an educational video segment being dis- 
played pertaining to trains. In other words, pressing a 
button lets a child trigger presentation of media content 
associated with the subject matter that is indicated by the 
button. This type of interaction between a user and media 
presentation is most suitable for children within the age 
groups of one to three, teaching a child basic motor skills 
and empowering the child, and is preferably used to in- 
struct a child about basic sets of abstract concepts re- 
garding, for example, colors, shapes, letters, numbers, 
animals, and instruments. 
[0038] it should also be noted that greater interactive content 

media also can be utilized. In this regard, the media con- 
tent presentation may include a "question and answer"" 
format, wherein the media content displayed directly 
poses a question that can be answered by pushing a par- 
ticular button. As an example, a segment of a video may 
state, "Click on the animal that eats bananas," and 
wherein the child then clicks on the button depicting a 
monkey and triggers the positive response "You're right! A 
monkey eats bananas!" or, alternatively, clicks on a button 
depicting another animal and triggers the response "Sorry, 
Please try again!" Alternatively, the media content presen- 



tation may include a "choose your own adventure" format, 
wherein the media content narrative pauses at key points 
in a storyline in order for the child determine the future 
direction of the story. As an example, a segment of the 
video may state, "Should you go take the road going North 
or the road going South?" and wherein, if the child then 
clicks on the button indicating "North" the story resumes 
with that choice as its basis and if the child then clicks on 
the button indicating "South" the story resumes with that 
alternative choice as its basis. 

[0039] As will be appreciated, overlay 102 is not generic to DVD 
112 because the overlay 102 provides illustratively labeled 
button 104 that are correlated to different portions of the 
media content of DVD 112. 

[0040] | n accordance with the present invention, the overlay 102 
of FIG. 1 is removably attachable to the base structure 
106 as illustrated in FIG. 2. Accordingly, the base struc- 
ture 106 may accept any one of various overlays corre- 
sponding to different DVDs that may be used in the multi- 
media system. Thus, for example, with reference to FIG. 3 
the three different media packages may be used with base 
structure 106. Indeed, each media package comprises a 
DVD and an overlay corresponding to that DVD's media 



content. DVDs 112, 116, 120 thus respectively corre- 
spond to overlays 110, 114, 118, and each of the overlays 
includes a different number of buttons with different indi- 
cia (not shown) thereon. 

[0041] with regard to the various aspects of the present inven- 
tion, the multimedia system of FIG. 1 is an example of a 
host system, the base structure 106 is an example of a 
controller, and the overlay is an example of a removable 
user interface (RUI). Additionally, the buttons of the over- 
lay 102 are an exemplary embodiment of user inputs. 

[0042] a preferred media package is illustrated in FIG. 4, and in- 
cludes a CD 130 having data for songs drawn to letters of 
the alphabet. The corresponding overlay 132 includes an 
array of buttons having these letters of the alphabetic il- 
lustrated thereon for effecting user selection of songs on 
the CD 130. A sleeve 134 is useful to store, protect, and 
identify the CD 130 that is correlated with the overlay 
132. Another preferred media package is illustrated in 
FIG. 5, wherein a DVD 136 has been used with a video 
recorder 138 to create videos. In accordance with the 
present invention, user actuation of a button of the over- 
lay initiates playback of a particular video corresponding 
to indicia (not shown) of that button. 



[0043] other preferred embodiments of media packages (not 

shown) include a media package for use or study of geo- 
graphic content regarding the United States or geometric 
shapes. In the former example, the overlay is arranged as 
a map with the buttons shaped and arranged as states. 
Upon pushing of a state shaped button then would result 
in presentation of educational information on that state, 
which information is stored on a DVD corresponding to 
the overlay. In the latter example, the overlay includes 
buttons of various geometric shapes, such as a circle, tri- 
angle, rectangle, and square. Upon pushing of a geomet- 
rically shaped button then would result in presentation of 
educational information on that particular geometric 
shape of the button, which information is stored on a DVD 
corresponding to the overlay. 

[0044] | n should be noted that, in the preferred embodiments of 
FIGS. 4 and 5, the overlays are examples of RUIs, and the 
CD and DVD are examples of machine readable media 
having media content. Additionally, the correspondence 
between a RUI and machine readable medium having the 
media content is represented in FIGS. 1 and 5 by the 
dashed arrows pointing therebetween. 

[0045] with respect to the attachment of an overlay to a con- 



troller, FIG. 6 illustrates an overlay 140 that is attachable 
to base structure 150, wherein an array of user inputs 
(represented by rectangles) corresponds identically to an 
electrical switch matrix of the base structure 150. Thus, 
inputs 142 corresponds with switch 152, whereby user 
actuation of input 142 results in a signal being generated 
by switch 152. A similar arrangement is illustrated in FIG. 
7; however, in FIG. 7 there are fewer user inputs than 
switches. Thus, for example, actuation of input 162 re- 
sults in a signal being generated by switches 172. In these 
illustrated arrangements, each of the particular inputs 
142,162 comprises a mechanical component that, when 
the respective overlay 140,160 is coupled to the base 
structure 150,170, is positioned directly above the re- 
spective switches 151,172. 
[0046] it should be understood that any desired or suitable n to 
m correlation of any number (n) inputs to any number (m) 
of controller switches is within the scope of the present 
invention. Furthermore, though the figures illustrate for 
convenience spatial alignments of user inputs to corre- 
lated controller switches, it should be understood that 
other alignments or associations facilitated by cantilevers, 
pads, moving parts, or electrical contacts correlating any 



one, any number, or any area of inputs to any one, any 
number, or any area of controller switches are within the 
scope of the present system. 

[0047] with reference now to FIGS. 8 and 9, an exemplary plan 
diagram of a RUI and controller is shown. The RUI 141 
comprises a thin membrane or sheet having inputs 143 
that comprise designated rectangular areas for guiding 
the application of pressure by a user's finger. Further- 
more, the inputs 143 comprise a 4x4 array. When the RUI 
is attached to the controller, each of the inputs 143 over- 
lie and align with rectangular switches 152 of a switch 
matrix of the controller 150. Thus, when the RUI 141 is 
attached to the controller 150, a user applying pressure to 
an input 143 causes a particular the switch 152 thereun- 
der to provide an electronic signal. 

[0048] a similar, but alternative exemplary plan diagram of a RUI 
and controller is shown, respectively, in FIGS. 10 and 11. 
In this instance, a switch matrix is included in the RUI 180 
rather than in the controller 190. Indeed, the switches 182 
of the switch matrix of the RUI 180 comprise, themselves, 
the user inputs of the present invention. When the RUI 
180 is attached to the controller 190, each of the inputs 
143 overlie and align with rectangular switches 152 of a 



switch matrix of the controller 150. A user applying pres- 
sure to a particular switch 182 of the RUI 180 causes a an 
electronic signal to be provided. 
[0049] whether an electronic signal is provided by a switch in the 
controller 150 of FIG. 9, or by a switch in the RUI 180 of 
FIG. 10, a processor in the controller, which processor 
preferably comprises a microprocessor, receives the signal 
provided by the switch when the RUI is attached to the 
controller. In this regard, a signal provided by a switch 
142 in controller 150 is communicated directly from the 
switch matrix to processor 154, and a signal provided by 
a switch 182 in the RUI 180 is communicated from the 
switch matrix of the RUI 180 to processor 194 in the con- 
troller 190 through electrical contacts 188 of the RUI 180 
that abut electrical contacts 192 of the controller 190. A 
power source, such as a battery (not shown), preferably is 
included in the controller for generating electrical signals 
from switches. 

[0050] upon receiving an electronic signal, ultimately in response 
to actuation of a user input of a RUI, the processor (in ac- 
cordance with a program that it runs) responds appropri- 
ately such as, for example, by causing an emitter, which is 
also included in the controller, to transmit an appropriate 



command to a media device. The emitter can be any wire- 
less transmission device, for example, a radio frequency 
(RF) transmitter, an infrared (IR) emitter, an IRDA device, 
or a Bluetooth device. Alternatively or in conjunction with 
a wireless device, the emitter can comprise any conduct- 
ing wire or fiber optic signal generator. The emitter sends 
signals to control external devices such as DVD players, 
CD players, computers, and televisions, just to name a 
few. The emitter can be coupled to one or more media 
devices through a parallel port connection, a serial port 
connection, or a USB port connection. Additionally, when 
the emitter comprises an IR emitter, the emitter preferably 
is a multiple angled emitter, which helps insure that 
transmissions are received despite potential line of sight 
obstacles. 

[0051] As will be appreciated, the appropriate response by the 
processor to an electronic signal will be dependent upon 
the media package, i.e., the media content being pre- 
sented and the RUI being utilized. To illustrate this "de- 
pendency" point, take for example the base structure 150 
of FIG. 6 and base structure 170 of FIG. 7. Either may ac- 
commodate any number of different overlays having simi- 
lar or varying input arrangements such as, for example, 



the overlay 140 of FIG. 6 and the overlay 160 of FIG. 7. In 
this regard, base structure 150 is interchangeable with 
base structure 160, i.e., each base structure 150,160 may 
receive overlays 140 and 160. Moreover, the media con- 
tent associated with overlay 140 may provide for work- 
place training of employees including, for example, six- 
teen training lessons to which the sixteen inputs of the 
overlay 140 correspond. In contrast, the media content 
associated with overlay 160 may comprise a five act play 
to which the five inputs of the overlay 160 correspond. In 
order for the processor of the base structure to take the 
appropriate response upon actuation of a user input of 
one of the overlays, the processor must be instructed how 
to respond as a function of the particular overlay to which 
it is attached. A signal received from one or more particu- 
lar switches when a user input 142 of overlay 140 is actu- 
ated most likely should not result in the same response 
when a signal is received from the same switches when a 
user input 172 of overlay 160 is actuated. A signal that is 
received from a switch of the controller when overlay 140 
is attached may result in the eighth training lesson being 
shown, whereas a signal that is received from the same 
switch of the controller when overlay 160 is attached may 



result in viewing of the third act of the play. 

[0052] | n order that the processor of the controller is properly in- 
structed how to react when a signal is received, each RUI 
contains machine executable instructions stored in a ma- 
chine readable medium, such as software stored in mem- 
ory of the RUI. In preferred embodiments, the software 
comprises a script that is interpreted by the processor by 
running a program that is a script engine or script inter- 
preter (hereinafter referred to as "Interpreter"). Further- 
more, the script stored in the memory of the RUI prefer- 
ably is at least partially compiled. The script essentially 
comprises control or navigational rules by which the In- 
terpreter determines an appropriate response to receipt of 
a signal upon actuation of a user input. By providing script 
that is specific to media content associated with a particu- 
lar overlay, overlays are able to couple to, and function 
with, similar or identical controllers; the scripts of the 
overlays provide the specific control or navigational rules 
appropriate to the media content to which the overlays 
correspond; in essence, the script provides the logic by 
which the Interpreter operates. 

[0053] The script is read by the Interpreter through electrical 

contacts between the RUI and the controller. Again, with 



reference to FIGS. 8 and 11, script in overlay 141 resides 
in script element 145 and script in overlay 180 resides in 
script element 184. Electrical contacts 147 in RUI 141 and 
electrical contacts 186 in RUI 180 abut, respectively, elec- 
trical contacts 156 in controller 150 and electrical con- 
tacts 196 in controller 190 and respectively connection 
the processors in controllers 150,190 in communication 
with script elements 145,184. Furthermore, the script is 
read when the overlay is connected to the controller, or 
alternatively, on a case by case basis as a signal is re- 
ceived by the processor. The script storage element can 
include, for example, a magnetic strip, a removable mem- 
ory cartridge, a memory disk, a read only memory (ROM) 
device, an erasable programmable read only memory 
(EPROM) device, any read only or read write memory de- 
vice, an EEPROM or FLASH ROM device, an I2C standard 
device on a serial chip, or any magnetic or optical media 
memory storage device. 
[0054] | t W j|| De appreciated that the script of a particular overlay, 
while dependent upon the media content, is not depen- 
dent upon, and thus is independent of, the particular host 
system, e.g., the particular DVD player that is used for 
presentation of the media content. Instead, the controller 



is dependent upon the particular host system in that the 
controller includes the particular communication protocol 
of the host system so that appropriate commands con- 
trolling the media presentation may be communicated to 
the host system. Moreover, the controller preferably in- 
cludes a library of communication protocols or codes for 
different host systems, whereby the same controller can 
be used with different host system similar to the multiple 
use capability of "universal" remotes with various elec- 
tronic devices of different manufacturers. The controller 
also preferably includes upgrade capabilities, whereby the 
library can be updated over time with additional commu- 
nication protocols to ensure compatibility with future host 
systems and components thereof. Each protocol enables 
the Interpreter to communicate commands to the host 
system via the emitter for control of the media presenta- 
tion. By making the RUI independent of the host system 
but dependent upon the media content, making the con- 
troller independent of the media package but dependent 
upon the host system, and by making RUIs removably at- 
tachable to different controllers, the present invention en- 
joys great flexibility and utility. Indeed, a single controller 
can serve a wide variety of overlays, and a single con- 



troller can be utilized with a wide variety of host systems. 

[0055] with additional regard to the library of communication 

protocols of the controller, the Interpreter may access and 
read command codes of a particular host system as part 
of an initialization process when the overlay is coupled to 
the controller, or the Interpreter may read command 
codes periodically or upon actuation of a user input. Upon 
receipt of a signal, the Interpreter first refers to the script 
for the appropriate response and, then, refers to the par- 
ticular protocol and command or commands of the host 
system, as reflected in the protocol for that host system, 
in order to achieve the appropriate response as identified 
with reference to the script. The Interpreter then causes 
the appropriate command or commands to be transmitted 
to the host system by the emitter. For example, an appro- 
priate response to a signal that is received by the Inter- 
preter may be, pursuant to the current script, to access a 
particular title and chapter, begin play, and then pause 
playback until an another signal is received as a result of a 
subsequent user actuation of a RUI input. To accomplish 
this response, the Interpreter determines the appropriate 
commands to communicate to the host system. 

[0056] with additional regard to the Interpreter, the script Ian- 



guage preferably comprises a complete media program- 
ming language written in modular fashion that includes 
features of conditional branches; states maintained; and 
variable data created, read, and updated. The Interpreter 
also preferably is backwards compatible for interpreting 
script written for older versions of the Interpreter, thereby 
allowing the software language to evolve without requir- 
ing hardware upgrades in the field. The script language 
preferably contains high level verbs that allow users to 
easily control interactive media, and contains all of the 
normal programming constructs, such as conditional 
statements, loops, macros, parameters, variable data, data 
storage, etc. 

[0057] Each script preferably is developed utilizing an application 
programming interface (API) which can be a simple script- 
ing language based upon standard XML protocols. The 
script language also preferably utilizes standards based 
and widely accepted XML syntax to provide the mecha- 
nism for scriptable media interactivity. Robust conditional 
logic and an event driven model enable considerable flex- 
ibility in the adaptability of instructions, making complex 
forms of interactivity possible. 

[0058] An exemplary script for an input comprising a button is 



shown in FIG. 12. In accordance with this simple example, 
when the Monkey Button is pressed, the presentation of 
the media content of Chapter 7 begins, which relates to 
monkeys. 

[0059] with regard to further detail of the script structure, the 

syntax is XML elements and attributes. Commands (verbs) 
are XML elements. Parameters are XML attributes. Using 
this syntax, the script language is easily created or 
changed. Commands can be upgraded by modifying the 
parameters (attributes). New commands can be added, or 
dropped. 

[0060] For example, if a command to issue the "Play" command 
to a DVD is desired, then the command that is utilized is 
<Play />. If later the behavior of this command is to be 
changed, then parameters (attributes) could be added. 
Thus, the inclusion of a parameter "seconds" could be 
added. This parameter, if present, would issue the Play 
command for "n" seconds and then Pause, and the com- 
mand would look like <Play seconds="10"/>. Further- 
more, such changes take place without modification of a 
compiler since they adhere to the XML syntax. 

[0061] Another aspect of XML that is utilized in the script lan- 
guage is the concept of "child elements," which provide 



many advantages. The primary use is to group commands 
to be executed when a particular user input (such as a 
button) is actuated. For example, a group of commands 
are issued when the "Monkey" button is pressed in accor- 
dance with the script of FIG. 13. This concept also is used 
for macros. 

[0062] As will be apparent from the foregoing, a script in accor- 
dance with preferred embodiments of the present inven- 
tion includes is a collection of media device independent 
commands for controlling media presentation, as illus- 
trated in FIG. 14. 

[0063] An example of a conditional statement in a script is shown 
in FIG. 15. Therein, all child elements (commands) are ex- 
ecuted if the condition is true. 

[0064] The exemplary script of FIG. 17 demonstrates a RUI hav- 
ing animal shaped user inputs comprising buttons. There 
are two buttons provided for, which include a Monkey 
button and an Elephant button. When the Monkey button 
is pressed, it displays the content in Chapter 7 of the 
DVD. When the button is pressed again it display the con- 
tent in Chapter 10. When it is pressed again, it reverts 
back to Chapter 7. When the Elephant button is pressed, it 
first displays Chapter 12, and when it is pressed again, it 



then Chapter 15. This exemplary code demonstrates the 
robustness of the present invention in providing an ap- 
propriate response to actuation of a user input based on 
prior history of the user session during the presentation. 

[0065] with reference to FIG. 18, the RUI represented therein 
contains, inter alia, a monkey shaped button and an ele- 
phant shaped button and the script element contains the 
script of FIG. 17. This particular RUI, for example, is asso- 
ciated with an educational video DVD about animals. Ad- 
ditionally, the controller includes the Interpreter and the 
library by which appropriate signals are able to be sent for 
controlling display of the media content on the DVD. The 
media device displaying the media content, for example, 
is a Sony DVD player. 

[0066] with reference to FIG. 16, machine-executable instruc- 
tions of the library that are specific to the Sony DVD 
player are illustrated. These instructions are stored within 
the library of the controller and enable the controller to 
communicate, in an appropriate protocol of the Sony DVD 
player (e.g., via infrared transmission), the device-specific 
code for the command that is to be performed by the Sony 
DVD player. Examples of the "Power" command and "Eject" 
command are shown. Data associated with commands 



also can be communicated utilizing the library instruc- 
tions (a command and associated data each generally be- 
ing referred to herein as a command). An illustrated ex- 
ample of this in FIG. 16 is the instruction for communicat- 
ing numeral "1" to the Sony DVD player. 

[0067] | n accordance with FIG. 18, when the monkey button is 
pressed, the Interpreter searches the Script to find the 
command to execute for this Button. Upon finding the ap- 
propriate command in the Script, the Interpreter checks 
the monkey flag in order to determine which Chapter to 
display. If the switch is 0, the Interpreter determines that 
Chapter 7 is to be displayed and, additionally, then sets 
the flag to 1. If, on the other hand, the flag is already 1, 
then the Interpreter determines that Chapter 10 is to be 
displayed and, additionally, sets the flag to 0. A similar 
method is utilized with respect to alternative actuation of 
the elephant button. 

[0068] As demonstrated in FIG. 18, the effect of pressing the 

same button may be dynamic. The first time the button is 
pressed one chapter is displayed. On the second press, a 
different chapter is displayed. Also note that in the script 
of FIG. 17, no reference is found reflecting that the media 
device is a Sony DVD player; the script is independent of 



the media device. Specific codes for executing the com- 
mands in the script on the Sony DVD player are found in 
the library of the controller. 

[0069] Scripts can be created with any available and suitable text 
editor. Additionally, scripts can be compiled into a ma- 
chine independent format suitable for placing in script 
storage. Compiling a script can greatly reduce its size and 
allow its maintenance in machine independent format. A 
"drag and drop" visual editor can aid programming in the 
overlay software language and enable a producer with lit- 
tle programming skills to create interactivity instructions 
for a specific overlay. An integrated DVD player can allow 
editing, playback and testing from a single workstation. 
More technical users can be provided the option of editing 
using a more traditional development interface. 

[0070] a programmer or developer adds commands to a "Table 
of Commands" in the Interpreter. The developer then pro- 
vides the address of a software routine that will be called 
when the script so indicates by reference to the a com- 
mand of the Table of Commands. 

[0071] For example, when the "Sleep" command is Interpreted, 
the referenced program code performs the following, 

[0072] a ) Fetch the parameter "seconds" 



[0073] b) Fetch the parameter "milliseconds" 

[0074] c ) Delay program execution for the appropriate amount of 
time as specified by the parameters. 

[0075] if jt were desired that the command be changed to have 
parameters for minutes and seconds instead of seconds 
and milliseconds, then it would be extremely easy to 
change the program code to support the different param- 
eters. Moreover, no changes in a compiler or the Inter- 
preter would be required. Thus, for a command to be re- 
moved, it only need be deleted from the Command Table 
and the code thereof removed that would otherwise be 
called in execution of the command. Conversely, to add a 
command, an entry in the Command Table on need be 
made with appropriate reference to the code for executing 
the command. 

[0076] | n accordance with preferred embodiments of the present 
invention, the script language preferably includes the fol- 
lowing commands that relate to DVD players: MENU (stops 
title playback and displays the top or root menu for the 
current title of the DVD); TITLE (stops title playback and 
displays the title menu); RESUME (returns to playback 
mode from menu mode at the same title position as when 
the menu was invoked); BACK (returns the display from a 



submenu to its parent menu); PLAY (causes the DVD to 
start playing, or resumes play of a paused item); STOP 
(stops the playing of the DVD); PAUSE (pauses the playing 
of the chapter); NEXTCHAPTER (seeks and plays the next 
chapter; will loop); PREVCHAPTER (seeks and plays the 
previous chapter. Will loop); TITLESEEK (seeks and plays 
the first chapter in the title; title number is 1 to 99); CH- 
PATERSEEK (seeks and plays the chapter in the current ti- 
tle; chapter number is 1 to 999); TIMESEEK (seeks to a 
specific time on the DVD; parameters include hour, 
minute, and second); FASTFORWARD (starts fast forward- 
ing); FASTREVERSE (starts fast reversing); PUSHBUTTON 
(simulates a button press on a remote control device); and 
PUSHNUMBERS (simulates pressing the number buttons). 
[0077] B as j C commands that are found in all scripts regardless of 
the actual implementation of the present invention prefer- 
ably include: PUSHPLAY (defines a new script; parameters 
include script type and id); BUTTON (defines commands 
that will be executed when signal for button is received); 
TRICKPLAY (defines a macro, whish is a collection of com- 
mands that will be executed multiple times; parameters 
can be passed that modify macro behavior); IF 
(Conditional command; will execute block of commands if 



condition is true); SET (sets value of a variable data item); 
@(FETCH) (returns value of a variable); INCREMENT 
(increments a variable with a range; when maximum limit 
is reached, will restart a minimum value); APPEND 
(appends a string value to a variable); BUTTONSON 
(enables PushPlay to react to button presses); BUTTON- 
SOFF (disables PushPlay from reacting to button presses); 
SLEEP (sleeps for time period; awakens upon RUI input ac- 
tuation); and SLEEPHARD (sleeps for time period; does not 
wakeup upon RUI input actuation). 

[0078] Commands and parameters of a preferred embodiment 
implemented in computer software can be found in the 
file titled "PushPlayScriptingAPI.txt", which is submitted 
herewith and is incorporated by reference herein. An ex- 
emplary script facilitating understanding of the present 
invention also can be found therein. 

[0079] | n a feature of the present invention, the Interpreter also 
monitors and records historical data regarding session 
use of a RUI. This collected data then may be utilized to 
modify future sessions or provide feedback to users. Such 
data may include the number of times a particular user in- 
put is actuated, the performance level of a user in inter- 
acting with an interactive media presentation, or the num- 



ber of "right" answers that are provided by a user in re- 
sponse to certain media content, such as an interactive 
educational video. Memory in the controller and or the 
overlay may be utilized in storing such monitored data. 
Instructions for monitoring and recording the data, if any, 
preferably are included in the script. 
[0080] | n another feature of the present invention, the controller 
is a multi mode device and the interpreter maintains the 
state of the controller, whereby different responses may 
be provided as a function of the current state of the con- 
troller upon receipt of the same signal. For example, when 
the mode switch is set to position "1," actuation of a spe- 
cific user input may initiate the playing of chapter 10; 
however, when the mode switch is set to position "2," ac- 
tuation of the same user input may initiate the playing of 
the next chapter, or the playing of chapter 36, for exam- 
ple. 

[0081] | n V j ew 0 f the foregoing detailed description of preferred 
embodiments of the present invention, it readily will be 
understood by those persons skilled in the art that the 
present invention is susceptible of broad utility and appli- 
cation. While various aspects have been described in cer- 
tain contexts, the aspects may be useful in other contexts 



as well. Many embodiments and adaptations of the 
present invention other than preferred embodiments de- 
scribed herein, as well as many variations, modifications, 
and equivalent arrangements, will be apparent from or 
reasonably suggested by the present invention and the 
foregoing description thereof, without departing from the 
substance or scope of the present invention. 

[0082] Furthermore, any sequence(s) and/or temporal order of 
steps of various processes described and claimed herein 
are those considered to be the best mode contemplated 
for carrying out the present invention. It should also be 
understood that, although steps of various processes may 
be shown and described as being in a preferred sequence 
or temporal order, the steps of any such processes are not 
limited to being carried out in any particular sequence or 
order, absent a specific indication of such to achieve a 
particular intended result. In most cases, the steps of such 
processes may be carried out in various different se- 
quences and orders, while still falling within the scope of 
the present inventions. 

[0083] Accordingly, while the present invention has been de- 
scribed herein in detail in relation to preferred embodi- 
ments, it is to be understood that this detailed description 



is only illustrative and exemplary of the present invention 
and is made merely for purposes of providing a full and 
enabling disclosure of the invention. The foregoing dis- 
closure is not intended, nor is to be construed to limit, the 
present invention or otherwise to exclude any such other 
embodiments, adaptations, variations, modifications and 
equivalent arrangements, the present invention being lim- 
ited only by claims and the equivalents thereof. 

[0084] For example, with regard to the preferred embodiment 
100 of FIG. 1, the apparatus for controlling the media 
presentation is disclosed as being a child's activity table. 
Alternatively the apparatus can be constructed as a laptop 
unit to be placed on or over the lap of a seated user and 
can be constructed as a tray like unit for coupling with, for 
example, a child's chair having rails for receiving a tray. 

[0085] | n addition thereto, the overlay 132 of FIG. 4, for example, 
has been illustrated with rectangular keys. However, any 
shape of the keys may be used in accordance with the 
present invention and, in fact, the keys may be shaped in 
a manner that indicates the media content presented by 
user actuation of the keys. For instance, the keys of the 
overlay 132 of FIG. 4 may be shaped as alphabetic letters, 
with the shape of the keys comprising in this instance the 



aforementioned indicia of the user inputs. Indeed, the 
materials, shapes, and sizes of overlays are completely 
variable. An overlay can comprise a touch screen or a 
sheet of cardboard with imprinted buttons. User inputs 
may be spring loaded buttons that are, for example, plas- 
tic or rubberized. Exemplary user inputs include mechani- 
cal actuators that couple to electrical switches of a con- 
troller. Other examples include user inputs that are elec- 
trical switches that couple to conductive contacts of a 
controller. 

[0086] Each RUI is specific to the medium content of a particular 
medium unit, with user input concepts that relate to its 
purpose and content, and look-and-feel branding based 
on the brand and/or content of the DVD. A RUI can have 
any size, shape, and form of user inputs that makes sense 
for its content and educational purpose. For example, the 
RUI and/or controller could resemble a book, wherein the 
turning of the pages of the book triggers a media event 
related to the content of the current page(s) of the book 
being viewed. The RUI also could take the form of a mini- 
piano, wherein certain notes or chords trigger particular 
video and/or audio presentations. More complex interac- 
tivity formats, like the "question-and-answer" format, 



could be used to teach and test specific notes and chords 
in learning to play the musical instrument. The RUI could 
further include a dance mat, wherein certain step combi- 
nations would trigger particular video and/or audio pre- 
sentations. A RUI also could comprise a character or doll, 
wherein pressing of certain parts of the body would trig- 
ger media events for teaching about the body parts, etc. 
The RUI and/or the controller also could include a voice 
recognition component, wherein voice commands to trig- 
ger media events would be enabled. 
[0087] Additionally, within the scope of the inventive system, 

there are various alternatives to storing scripts in a script 
element of a RUI for access by the Interpreter. Such alter- 
natives include dynamically reading and accessing the 
script by the Interpreter, either wirelessly (IR, IRDA, radio) 
or wired (rs232, Ethernet, USB, etc.). This is especially 
convenient when the script has been compiled, making it 
easily portable to many different environments. Of course, 
the script that is accessed by the Interpreter would still 
need to be dependent upon the RUI that is used with the 
controller. 

[0088] it w i|| also be appreciated by those having ordinary skill in 
the art that the present invention encompasses not only 



presentation of media content, but control of other media 
events utilizing a controller and removable RUI. Thus, for 
instance, a command to record media content can be 
communicated to a host system in accordance with the 
present invention, with the RUI being associated with the 
media content to be recorded. 
[0089] Finally, while the present invention has been described 

with regard to preferred embodiments directed to children 
toys and/or child education, the present invention is 
equally useful in a wide range of applications ranging 
from educational tools and product demonstrations to 
healthcare applications. 



